# Inference Optimization

NovaSky is an AI technology platform dedicated to enhancing the performance of code generation and inference models. It significantly improves the performance of non-inference models, making them excel in the field of code generation, through innovative test-time expansion techniques (such as S*) and reinforcement learning distillation inference. The platform is committed to providing developers with efficient and low-cost model training and optimization solutions, helping them achieve higher efficiency and accuracy in programming tasks. NovaSky's technical background originates from Sky Computing Lab @ Berkeley, with strong academic support and cutting-edge technology research foundation. Currently, NovaSky offers a variety of model optimization methods, including but not limited to inference cost optimization and model distillation techniques, to meet the needs of different developers.

The MNN Large Model Android App, developed by Alibaba, is an Android application based on large language models (LLMs). It supports various input and output modalities, including text generation, image recognition, and audio transcription. The app is optimized for inference performance to ensure efficient operation on mobile devices while safeguarding user data privacy, with all processing done locally. It supports a variety of leading model providers, such as Qwen, Gemma, and Llama, making it suitable for various scenarios.

Developed by the DeepSeek team, the DeepSeek-R1-Distill-Qwen-1.5B is an open-source language model optimized through distillation based on the Qwen2.5 series. This model significantly enhances inference capabilities and performance through large-scale reinforcement learning and data distillation techniques while maintaining a compact model size. It excels in various benchmark tests, especially in mathematics, code generation, and reasoning tasks. The model supports commercial use and allows users to modify and develop derivative works, making it ideal for research institutions and enterprises looking to create high-performance natural language processing applications.